Service providing system including display device and mobile device, and method for providing service using the same

ABSTRACT

A display device provided to a vehicle includes a communication unit which communicates with a mobile device, a control unit which acquires a keyword in a call conversation if the mobile device makes a call, and a display unit which displays additional information corresponding to the keyword. Accordingly, the display device can provide the user with services corresponding to keywords of the call conversation with convenience.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority from Korean Patent Application Nos.10-2013-0000322, filed on Jan. 2, 2013, 10-2013-0012264, filed on Feb.4, 2013, and 10-2013-0013480, filed on Feb. 6, 2013, in the KoreanIntellectual Property Office, and U.S. Provisional Application No.61/658,095, filed on Jun. 11, 2012, in the United States Patents andTrademark Office, the disclosures of which are incorporated herein byreference in their entireties.

BACKGROUND

1. Field

Apparatuses and methods consistent with exemplary embodiments relate toa service providing system which includes a display device and a mobiledevice, and a method for providing a service using the same, and moreparticularly, to a service providing system which includes a displaydevice for conveniently providing a service related to, in particular, acall conversation, and a mobile device, and a method for providing aservice using the same.

2. Description of the Related Art

Recently, due to development of communications technology and technologyof electronic devices, diverse portable terminal devices and displaydevices have developed. A large number of people have personal portableterminal devices, and display devices which perform diverse functionsare installed in vehicles or on the streets.

A display device installed in vehicles displays state information of thecar and menus such as temperature control so that the user may input acontrol command. In addition, the display device installed in vehiclesmay have a navigation function so that it helps the user easily find aroad. A personal portable communication device enables the user totransmit and receive phone calls or text messages.

While driving a car, the user may talk on the phone, try to call a thirdparty, or change a destination. In general, in order to try to call athird party, the user may input the third party's phone number to theuser's portable communication device or search for the third party froma stored phone number list and contact the found telephone number. Inorder to change a destination, the user may input a destination to adisplay device, search for the destination, and select the founddestination. In a particular situation such as driving, this input andsearching process may incur a risk and make typos while inputtinginformation on the third party or the destination. Accordingly, there isa growing need for convenience when trying to call somebody or whenchanging a destination while driving.

In addition, when the user talks on the phone, they generally talk abouttheir interests. Accordingly, the user may wish to receive informationon their interests without searching for the information.

Therefore, there is a growing need for conveniently making a call,changing a destination, or receiving information on their interestsusing the display device.

SUMMARY

Exemplary embodiments overcome the above disadvantages and otherdisadvantages not described above. Also, exemplary embodiments are notrequired to overcome the disadvantages described above, and an exemplaryembodiment may not overcome any of the problems described above.

An exemplary embodiment provides a service providing system whichincludes a display device capable of displaying additional informationbased on a call conversation of the user and conveniently providing acorresponding service, and a mobile device, and a method for providing aservice using the same.

According to an aspect of an exemplary embodiment, a display devicewhich is provided at a vehicle, the display device comprises acommunicator configured to communicate with a mobile device, acontroller configured to acquire at least one keyword in a callconversation if the mobile device makes a call, and a display configuredto display additional information corresponding to the at least onekeyword.

The additional information may comprise advertisement informationcorresponding to the at least one keyword, if a server configured tostore an advertisement database transfers the advertisement informationcorresponding to the at least one keyword, the communicator receives thetransferred advertisement information through the mobile device, and thecontroller displays the received advertisement information using thedisplay.

If the displayed additional information is selected, the controller mayprovide a service corresponding to the selected additional information.

The additional information may comprise at least one from among locationinformation, contact information, multimedia content, and advertisementinformation, and if the location information is selected, the controllerprovides a navigation service for guiding a route to a destinationcorresponding to the location information, if the contact information isselected, the controller provides a call service for making a call tothe contact information, if the multimedia content is selected, thecontroller provides a service for reproducing the multimedia content,and if the advertisement information is selected, the controllerprovides an advertisement service for displaying a screen including theadvertisement information.

The display device may further comprise a storage, wherein thecontroller searches for the additional information corresponding to theat least one keyword from among information which is stored in at leastone from among a server, the mobile device, another mobile device whichis connected to the mobile device for call, and the storage.

If the call conversation of the mobile device is received through thecommunicator, the controller may extract and acquire the at least onekeyword from the call conversation and search for the additionalinformation based on the at least one keyword.

According to another aspect of an exemplary embodiment, a mobile deviceincludes a communicator configured to communicate with a display deviceprovided at a vehicle, a call connector configured to make a call toanother mobile device, and a controller configured to transfer a callconversation to a server, receives advertisement informationcorresponding to at least one keyword in the call conversation, andtransfers the advertisement information to the display device.

According to yet another aspect of an exemplary embodiment, a serviceproviding system includes a mobile device configured to make a call toanother mobile device, and a display device configured to communicatewith the mobile device and acquire at least one keyword in a callconversation if the mobile device makes the call to the another mobiledevice, wherein the display device displays additional informationcorresponding to the at least one keyword.

According to yet another aspect of an exemplary embodiment, a method forproviding a service using a display device is provided. The methodincludes communicating with a mobile device, acquiring at least onekeyword in a call conversation if the mobile device makes a call, anddisplaying additional information corresponding to the at least onekeyword.

The additional information may comprise advertisement informationcorresponding to the at least one keyword, if a server which stores anadvertisement database transfers the advertisement informationcorresponding to the at least one keyword, receiving the transferredadvertisement information through the mobile device, and displaying thereceived advertisement information.

The method may further include if the displayed additional informationis selected, providing a service corresponding to the selectedadditional information.

The additional information may comprise at least one from among locationinformation, contact information, multimedia content, and advertisementinformation, and in the providing of the service, if the locationinformation is selected, a navigation service for guiding a route to adestination corresponding to the location information, if the contactinformation is selected, a call service for making a call related to thecontact information is provided, if the multimedia content is selected,a service for reproducing the multimedia content is provided, and if theadvertisement information is selected, an advertisement service fordisplaying a screen including the advertisement information is provided.

The method may further comprise searching for the additional informationcorresponding to the at least one keyword from among information whichis stored in at least one of a server, the mobile device, another mobiledevice which is connected to the mobile device, and a storage.

The method may further comprise if the call conversation of the mobiledevice is received, extracting and acquiring the at least one keywordfrom the call conversation and searching for the additional informationbased on the at least one keyword.

According to another aspect of an exemplary embodiment, a method forproviding a service using a mobile device includes communicating with adisplay device provided at a vehicle, making a call to another mobiledevice, and transferring a call conversation to a server, receivingadvertisement information corresponding to at least one keyword in thecall conversation, and transferring the advertisement information to thedisplay device.

According to an aspect of an exemplary embodiment, the server maycategorize at least the call conversation according to users. Also, thereceived advertisement information may be displayed after an end of thecall conversation.

According to the diverse exemplary embodiments, a service providingsystem which includes a display device and a mobile device may displayadditional information based on a call conversation of the user andprovide a corresponding service.

Additional and/or other aspects and advantages of the exemplaryembodiments will be set forth in part in the description which followsand, in part, will be obvious from the description, or may be learned bypractice of the invention.

BRIEF DESCRIPTION OF THE DRAWING FIGURES

The above and/or other aspects of the exemplary embodiments will be moreapparent with reference to the accompanying drawings, in which:

FIG. 1 illustrates a service providing system which is applied to avehicle according to an exemplary embodiment;

FIG. 2 is a block diagram of a system including a server and mobiledevices according to an exemplary embodiment;

FIG. 3 is a block diagram of a display device according to an exemplaryembodiment;

FIG. 4 is a block diagram of a mobile device according to an exemplaryembodiment;

FIG. 5 is a block diagram of a server according to an exemplaryembodiment;

FIG. 6 is a timing chart illustrating a method for extracting a keywordwhile talking over the phone and displaying additional information onthe display device according to the first exemplary embodiment;

FIG. 7 is a timing chart illustrating a method for extracting a keywordwhile talking over the phone and displaying additional information onthe display device according to the second exemplary embodiment;

FIG. 8 is a timing chart illustrating a method for extracting a keywordwhile talking over the phone and displaying additional information onthe display device according to the third exemplary embodiment;

FIG. 9 is a timing chart illustrating a method for extracting a keywordwhile talking over the phone and displaying additional information onthe display device according to the fourth exemplary embodiment;

FIG. 10 is a timing chart illustrating a method for extracting a keywordwhile talking over the phone and displaying additional information onthe display device according to the fifth exemplary embodiment;

FIG. 11 illustrates display of additional information according to anexemplary embodiment;

FIG. 12 illustrates a service of changing a destination according to anexemplary embodiment;

FIG. 13 illustrates a service of making a call to a third partyaccording to an exemplary embodiment;

FIG. 14 is a block diagram of a configuration of a display deviceaccording to another exemplary embodiment;

FIG. 15 is a timing chart illustrating a method for providing anadvertisement service according to an exemplary embodiment;

FIG. 16 is a timing chart illustrating a method for providing anadvertisement service according to another exemplary embodiment;

FIG. 17 illustrates an exemplary embodiment in which the mobile deviceand the display device are connected to a vehicle according to anexemplary embodiment;

FIG. 18 illustrates a method for providing a service to a plurality ofterminal devices according to an exemplary embodiment;

FIG. 19 illustrates a data frame format of a controller area network(CAN) according to an exemplary embodiment;

FIG. 20 is a flow chart illustrating a method for providing a serviceusing a display device according to an exemplary embodiment; and

FIG. 21 is a flow chart illustrating a method for providing a serviceusing a mobile device according to an exemplary embodiment.

DETAILED DESCRIPTION OF THE EXEMPLARY EMBODIMENTS

Certain exemplary embodiments will now be described in greater detailwith reference to the accompanying drawings.

In the following description, the same drawing reference numerals areused for the same elements even in different drawings. The mattersdefined in the description, such as detailed construction and elements,are provided to assist in a comprehensive understanding of the exemplaryembodiments. Thus, it is apparent that the exemplary embodiments can becarried out without those specifically defined matters. Also, well-knownfunctions or constructions are not described in detail since they wouldobscure the invention with unnecessary detail.

FIG. 1 illustrates a service providing system which is applied to avehicle according to an exemplary embodiment.

With reference to FIG. 1, the service providing system 1000 may includea display device 100, a mobile device 200, and an electronic controlunit (ECU) 300.

The display device 100 may be built in the vehicle or be detachable fromthe vehicle. For example, the display device 100 may be head units(H/Us), navigators, tablet personal computers (PCs), electronic pictureframes or the like which are provided in the vehicle. The display device100 may display diverse state information on the vehicle and controlmenus which are received from the ECU 300, or display applications whichare received from the mobile device 200.

The mobile device 200 may be mobile phones, smart phones, personaldigital assistants (PDAs) or the like which include a cellularcommunication module. The cellular communication module is connected toan external device via a base station of a cellular system through oneor more antennas (not shown) using a wireless access technologyaccording to a cellular communication protocol. The mobile device 200transmits or receives wireless signals containing a voice call, a videocall, or a message with other communicable devices having a phonenumber.

The ECU 300 is an embedded system to control at least one of anelectrical system and a sub system of the vehicle. The ECU 300 mayinclude an electricity and engine control module, a power train controlmodule, a transfer control module, a brake control module, a centralcontrol module, a central timing control module, a general electronicmodule, a body control module, a suspension control module, etc.Accordingly, the ECU 300 receives information from diverse sensors ofthe vehicle and controls overall operation of the vehicle including anautomatic transmitter, a drive system, a braking system, a steeringsystem, etc.

The display device 100 may be connected to the mobile device 200 and theECU 300 using diverse communication methods. For example, the displaydevice 100 may be connected to the mobile device 200 using a cable suchas a universal serial bus (USB), or may be connected to the mobiledevice 200 wirelessly using local wireless communication methods such asWi-Fi or Bluetooth. The mobile device 200 which is connected to thedisplay device 100 may transfer diverse data including incoming callsand messages to the display device 100. The display device 100 may storeor display the transferred diverse data. In addition, if the displaydevice 100 receives a command to transfer data to an external device,the display device 100 may transfer the data and the command to themobile device 200 and thus the mobile device 200 may transfer thereceived data to the external device in accordance with the command. Thedisplay device 100 and the mobile device 200 may transmit or receiveauthority information to/from each other, and may encrypt and transfer amessage. When transferring data, the display device 100 or the mobiledevice 200 which receives the data identifies the authority informationand performs a corresponding operation so that malfunctioning of otherdevices or false data transfer may be prevented.

The display device 100 may be connected to the ECU 300. In an exemplaryembodiment, the display device 100 may be connected to the ECU 300through a controller area network (CAN). The CAN will be describedlater. If The ECU 300 is connected to the display device 100, the ECU300 transfers detected vehicle state information to the display device100 and then the display device 100 displays or store the transferredvehicle state information. In addition, the display device 100 maydisplay a vehicle control menu, and if the display device 100 receives avehicle control command from the user, the display device 100 maytransfer the input control command to the ECU 300. For example, the usermay control the vehicle, such as on and off of headlights andtemperature settings of the inside of the vehicle, through the displaydevice 100. The ECU 300 receives the control command and controls acorresponding module.

If the mobile device 200 receives a command to make a call, transfer amessage, or transfer and receive data from the display device 100, themobile device 200 is connected to an external communication device or aserver so as to perform an operation corresponding to the receivedcommand.

FIG. 2 is a block diagram of a system including a server and mobiledevices according to an exemplary embodiment.

With reference to FIG. 2, a first and second mobile device 200-1 and200-2 and a server 400 are shown.

The first and second mobile device 200-1 and 200-2 each include acellular communication module (not shown) as described above withreference to FIG. 1. Accordingly, the first and second mobile device200-1 and 200-2 are connected to each other using a wireless accesstechnology according to a general cellular communication protocol. Thefirst and second mobile device 200-1 and 200-2 perform voice call, videocall, message transfer, and data transfer. The first and second mobiledevice 200-1 and 200-2 may communicate with the server 400.

In the system 2000 shown in FIG. 2, the type of the server 400 may varybased on its various functions. With respect to relationship with theserver 400, the first and second mobile device 200-1 and 200-2 mayperform the same function, and thus are referred to as the mobile device200.

For example, if the mobile device 200 requests location information, theserver 400 may be a map data server which stores map-related data. Ifthe mobile device 200 requests advertisement information, the server 400may be an advertisement server. If the mobile device 200 requeststraffic information, the server 400 may be a traffic information serverwhich stores real-time traffic information. The server 400 may notperform a single specific function but store diverse information. Inaddition, if the server 400 receives a request for information from themobile device 200, the server 400 may search other servers or webs andtransfer the requested information to the mobile device 200.

In another exemplary embodiment, the server 400 may not be a physicallyexisting server but be a web such as internet. In addition, the server400 may be a management server which generates a user profilecorresponding to user information received from the mobile device 200and stores information on the user. That is, the server 400 may receivea call conversation from the mobile device 200. The server 400 may storethe call conversation in a corresponding user profile and extract akeyword from the call conversation. The server 400 may search foradvertisement information which matches the extracted keyword from theadvertisement server 400, and transfer the advertisement information tothe mobile device 200.

For example, the mobile device 200 may be connected to the server 400using a wireless local area network (LAN) such as Wi-Fi.

As described above, the mobile device 200 may be connected to othercommunication devices using a cellular communication method to transmitand receive voice call or data, and may be connected to the server 400using a wireless LAN to transmit and receive data. Until now, theservice providing system 1000, and the system 2000 including the server400 and the mobile device 200 have been described. The display device100 and the mobile device 200 in the service providing system 1000 aredescribed below.

FIG. 3 is a block diagram of a display device according to an exemplaryembodiment.

With reference to FIG. 3, the display device 100 may include a displayunit 130, a control unit 140, and a communication unit 150.

The communication unit 150 communicates with the mobile device 200.Communication with the mobile device 200 may be performed using a cableor wirelessly. If the mobile device 200 performs a call connection, thecommunication unit 150 receives a call conversation and transfers theuser's voice to the mobile device 200. The communication unit 150transfers an extracted keyword to the mobile device 200 and receivesadditional information corresponding to the keyword from the mobiledevice 200. The keyword indicates main terms such as person's names,place names, film titles, and product names. The additional informationis information related to the keyword. For example, if a keyword is aperson's name, additional information may be the person's contactinformation, if a keyword is a place name, additional information may beplace information, and if a keyword is a film title, additionalinformation may be film advertisement information.

The display unit 130 displays the additional information correspondingto the keyword. The display unit 130 may be at least one of a liquidcrystal display, a thin film transistor-liquid crystal display, anorganic light emitting diode, a flexible display, and athree-dimensional display. A method for displaying the additionalinformation corresponding to the keyword will be described later.

If the mobile device 200 makes a call, the control unit 140 acquires akeyword in a call conversation. In an exemplary embodiment, to acquire akeyword, the display device 100 receives an audio signal of an analogformat including user voice, and converts the audio signal into adigital signal. The display device 100 removes noise from the digitalsignal and determines a keyword in the noise-removed digital signal. Inanother exemplary embodiment, the display device 100 generates theconverted digital signal as text information and determines a keyword byanalyzing the text information.

The control unit 140 searches for additional information using theacquired keyword. The control unit 140 may search a storage unit (notshown) of the display device 100. In addition, after the control unit140 transfers a search command to the mobile device 200, the server 400,the mobile device 200, or a communication device which is connected tothe mobile device 200 may be searched for the additional information.

In addition, if the displayed additional information is selected, thecontrol unit 140 provides a service corresponding to the selectedadditional information. For example, if location information isselected, a navigation service for guiding a route to a destinationcorresponding to the location information may be provided. If contactinformation is selected, a call service for making a call to the contactinformation may be provided. If multimedia content is selected, themultimedia content may be reproduced. If advertisement information isselected, the advertisement information may be reproduced. The controlunit 140 controls all the components of the display device 100 includingthe display unit 130 and the communication unit 150.

The display device 100 may further include a storage unit (not shown).The storage unit may store detected keywords, received additionalinformation, phone numbers, map data, etc.

FIG. 4 is a block diagram of a mobile device according to an exemplaryembodiment.

With reference to FIG. 4, the mobile device 200 may include acommunication unit 210, a call connection unit 220, and a control unit230.

The communication unit 210 communicates with the display device 100. Ifthe mobile device 200 makes a call to another mobile device, thecommunication unit 210 transfers a call conversation to the displaydevice 100. In addition, the communication unit 210 may receive akeyword from the display device 100, and transfer additionalinformation, which is found using the keyword by a server, the mobiledevice 200, or the connected mobile device, to the display device 100.

The call connection unit 220 may include a cellular communication module(not shown) and thus can make a call to other mobile devices. The callconnection unit 220 is shown in FIG. 4 as a separate component, but maybe included in the communication unit 210.

The control unit 230 searches for additional information using akeyword. If the display device 100 does not perform a function ofextracting keywords, the control unit 230 of the mobile device 200 mayextract keywords. Since the method for extracting a keyword has beendescribed above, description thereof is not repeated. The mobile device200 may further include a storage unit (not shown). The storage unit maystore detected keywords, received additional information, phone numbers,map data, etc.

The control unit 230 may control the communication unit 210 to transfera call conversation to the server 400, to receive additional informationcorresponding to a keyword included in the call conversation, and totransfer the received additional information to the display device 100.In particular, the control unit 230 may control the communication unit210 to receive advertisement information from the server 400 and totransfer the advertisement information to the display device 100.

FIG. 5 is a block diagram of a server according to an exemplaryembodiment.

With reference to FIG. 5, the server 400 may include a communicationunit 410 and a control unit 420. The server 400 may receive a callconversation, extract a keyword, and transfer additional informationrelated to the keyword to the mobile device 200.

The communication unit 410 receives a call conversation and locationinformation from the mobile device 200. The call conversation andlocation information may be encrypted and transferred. The server 400may further include a storage unit (not shown) which categorizes thecall conversation and the location information according to users orlocations and stores them.

The control unit 420 extracts a call keyword from the call conversationand searches for advertisement information based on the call keyword andthe location information. The call keyword indicates main terms in thecall conversation. The call keyword is extracted by giving a priority torepeated terms or a set of terms which belong to one category. Forexample, in a call conversation, if movies are discussed, the term“movie” may be repeated and the terms “movie A”, “movie B”, “AA theater”and “BB theater” may be extracted. In this case, “movie A”, “movie B”,“AA theater” and “BB theater” may be extracted as the call keywords. Thecontrol unit 420 may give a priority to the extracted terms based on thenumber of times a term is repeated (i.e., the repeat count).

If the user is on XXX street, the control unit 420 searches forinformation on adjacent theaters or information on movie A usingreceived location information on XXX street and the call keyword such asmovie A. The communication unit 410 may transmit the found advertisementinformation to at least one of the display device 100, the mobile device200, and an external display device which is located within apredetermined area. For example, the external display device may be apublic information display (PID) which is installed on streets.

The external display device within the predetermined area may be set toan external display device within a predetermined distance, e.g. 10 m,of the mobile device 200, or may be set to an external display devicewhich is the most adjacent to the mobile device 200.

The server 400 may be a simple search server. In this case, the server400 may receive a keyword from the mobile device 200, search foradditional information related to the keyword, and transfer theadditional information to the mobile device 200. The server 400 maystore data regarding the additional information as a database in thestorage unit (not shown).

Until now, the display device 100, the mobile device 200, and the server400 which constitute the system have been described. Hereinbelow,diverse exemplary embodiments regarding a method for providing a serviceusing the display device 100 are described.

FIG. 6 is a timing chart illustrating a method for extracting a keywordwhile talking over the phone and displaying additional information onthe display device according to the first exemplary embodiment. In thefirst exemplary embodiment of FIG. 6, the mobile device 200 extracts akeyword from a call conversation and searches the storage unit of themobile device 200.

With reference to FIG. 6, in operation S610, the mobile device 200receives a call signal from another mobile device. In operation S620,the mobile device 200 transfers the received call conversation to thedisplay device 100. The mobile device 200 may transfer the callconversation to the display device 100 by processing the call signal. Inaddition, the mobile device 200 may transfer the received call signal asit is to the display device 100. At this time, the display device 100may display the same screen as one that is displayed on the mobiledevice 200, or may display a unique screen of the display device 100 byexecuting a predetermined application when a call signal is received.

In operation S630, the mobile device 200 extracts a keyword from thecall conversation and searches for additional information which islinked to the keyword. The mobile device 200 receives an audio signal ofanalog format including the user's voice and converts the audio signalinto a digital signal. The mobile device 200 may remove noise from thedigital signal, determine a keyword from the digital signal of whichnoise is removed, and extract the keyword. In addition, the mobiledevice 200 may generate text information using the converted digitalsignal, analyze the text information, and determine a keyword.

The mobile device 200 analyzes the keyword and searches the storage ofthe mobile device 200. For example, the keyword may be a person's nameor a place name. The additional information is information related tothe keyword. For example, if a keyword is a person's name, additionalinformation may be the person's contact information. If a keyword is aplace name, additional information may be place information.

If the extracted keyword is a person's name, the mobile device 200 maysearch a phone number list stored in the storage unit. If the person'sname is found in the list, the mobile device 200 determines thatinformation such as a phone number and a photograph which are mappedwith the person's name is additional information. The mobile device 200may store map data and extract a place name as a keyword. At this time,if the mobile device 200 searches the map data and finds the place namein the map data, the mobile device 200 determines that information suchas an address and a phone number which are mapped with the place name isadditional information.

In operation S640, the mobile device 200 transfers the keyword and thefound additional information to the display device 100. Searching forand transferring the additional information using the mobile device 200may be performed in real time while talking over the phone.Alternatively, searching for the additional information using the mobiledevice 200 may be performed in real time while talking over the phone,and the found additional information may be temporarily stored and betransferred to the display device 100 after the call is finished. Inoperation S650, the display device 100 displays the keyword and theadditional information. A detailed displaying method will be describedlater.

FIG. 7 is a timing chart illustrating a method for extracting a keywordwhile talking over the phone and displaying additional information onthe display device according to the second exemplary embodiment. In thesecond exemplary embodiment of FIG. 7, the display device 100 extracts akeyword from a call conversation and searches for additionalinformation.

With reference to FIG. 7, in operation S710, the mobile device 200receives a call signal from another mobile device. In operation S720,the mobile device 200 transfers received call conversation to thedisplay device 100. If the display device 100 receives the callconversation from the mobile device 200, the display device 100 executesa predetermined application and displays a unique call screen.

In operation S730, the display device 100 extracts a keyword from thecall conversation and searches for additional information related to thekeyword. The process of extracting a keyword has been described above,so detailed description is not repeated. The display device 100 maysearch its storage unit for the additional information. If the extractedkeyword is a person's name, the display device 100 searches a phonenumber list. If the extracted keyword is a place name and the displaydevice 100 stores map data, the display device 100 searches the mapdata.

If the display device 100 does not store a phone number list or mapdata, the display device 100 may transfer the keyword to the mobiledevice 200. If the mobile device 200 receives the keyword, the mobiledevice 200 may search a stored phone number list or map data foradditional information related to the keyword. As described above, ifthe keyword is a person's name, the mobile device 200 searches a phonenumber list. If the person's name is found in the list, the mobiledevice 200 determines that information such as a phone number and aphotograph which are mapped with the person's name is the additionalinformation. If the keyword is a place name, the mobile device 200searches map data. The mobile device 200 searches for the additionalinformation, e.g. a phone number, photo, and address, related to thekeyword, and transfers the found additional information to the displaydevice 100.

In operation S740, the display device 100 displays the keyword and theadditional information.

FIG. 8 is a timing chart illustrating a method for extracting a keywordwhile talking over the phone and displaying additional information onthe display device according to the third exemplary embodiment. In thethird exemplary embodiment of FIG. 8, the mobile device 200 extracts akeyword from a call conversation and requests that the server 400 searchfor additional information. In general, the display device 100 or themobile device 200 only stores limited data, e.g. telephone numbers.Accordingly, content information such as an advertisement, or specificplace information may not be searched for by only searching the displaydevice 100 or the mobile device 200.

With reference to FIG. 8, in operation S810, the mobile device 200receives a call signal from another mobile device. In operation S820,the mobile device 200 transfers a received call conversation to thedisplay device 100. In operation S830, the mobile device 200 extracts akeyword from the call conversation.

In operation S840, the mobile device 200 transfers the extracted keywordto the server 400-1. In operation S850, the server 400-1 receives thekeyword and searches for additional information related to the keyword.A plurality of keywords may be extracted. For example, if the keyword isa business name, the server 400-1 may search for an address and a phonenumber related to the business name. If a plurality of keywords areextracted, the server 400-1 may give a priority to the keywords based ona repeat count, and additional information related to less than apredetermined number of keywords may be searched for. For example, ifkeywords which are given priority are “movie AA” and “BB theater”, theserver 400-1 searches for advertisement information related to “movieAA” or advertisement information related to “BB theater” as additionalinformation.

In operation S860, the server 400-1 may receive a keyword from themobile device 200 in real time and transfer found additional informationto the mobile device 200 in real time. In operation S870, the mobiledevice 200 transfers the keyword and the received additional informationto the display device 100. In operation S880, the display device 100displays the keyword and the additional information.

FIG. 9 is a timing chart illustrating a method for extracting a keywordwhile talking over the phone and displaying additional information onthe display device according to the fourth exemplary embodiment. In thefourth exemplary embodiment of FIG. 9, the mobile device 200 transfers acall conversation to a server 400-2, and the server 400-2 extracts akeyword from the call conversation and searches for additionalinformation.

With reference to FIG. 9, in operation S910, the mobile device 200receives a call signal from another mobile device. In operation S920,the mobile device 200 transfers a received call conversation to thedisplay device 100.

In operation S930, the mobile device 200 transfers the call conversationto the server 400-2. At this time, the server 400-2 may not be a generalsearch server but be a management server to generate and manage aprofile according to users. The server 400-2 may generate a user profilefor each user and store a received call conversation in a correspondinguser profile. If there is a previously generated user profile, areceived call conversation may be stored in a corresponding previouslygenerated user profile. When the mobile device 200 transfers the callconversation to the server 400-2, a unique identifier (e.g. anidentification or a phone number) of the mobile device 200 may betransferred together. In addition, the call conversation may beencrypted and transmitted for security.

In operation S940, the server 400-2 extracts a keyword from the callconversation and searches for additional information related to thekeyword. Extracting a keyword from the call conversation and searchingfor additional information may be performed in a similar manner asdescribed above. In operation S950, the server 400-2 may transfer thekeyword and the additional information to the mobile device 200, or mayonly transfer the additional information. In operation S960, the mobiledevice transfers the keyword and the additional information to thedisplay device 100. In operation S970, the display device 100 displaysthe keyword and the additional information.

FIG. 10 is a timing chart illustrating a method for extracting a keywordwhile talking over the phone and displaying additional information onthe display device according to the fifth exemplary embodiment. In thefifth exemplary embodiment of FIG. 10, the first mobile device 200-1requests a search from the second mobile device 200-2 which the mobiledevice 200-1 is talking over the phone with. For example, if “personAAA” is mentioned in the call conversation, contact information of“person AAA” may not be stored in the first mobile device 200-1 but maybe stored in the second mobile device 200-2. In this case, the firstmobile device 200-1 may receive the contact information of AAA from thesecond mobile device 200-2.

With reference to FIG. 10, in operation S1010, the first mobile device200-1 receives a call signal from the second mobile device 200-2. Inoperation S1020, the first mobile device 200-1 transfers a callconversation to the display device 100.

In operation S1030, the first mobile device 200-1 extracts a keyword,e.g. a person's name, and searches a phone number list stored in itsstorage unit. If the first mobile device 200-1 does not search for aphone number corresponding to the keyword, the first mobile device 200-1requests the second mobile device 200-2 to search for additionalinformation related to the keyword in operation S1040. That is, thefirst mobile device 200-1 requests the second mobile device 200-2 tosearch for contact information corresponding to the extracted person'sname. In operation S1050, the second mobile device 200-2 searches forthe additional information at the request of the first mobile device200-1 and transfers the additional information to the first mobiledevice 200-1. If the second mobile device 200-2 does not also find theadditional information, the second mobile device 200-2 may transfer asignal indicating that the requested additional information does notexist, to the first mobile device 200-1.

In operation S1060, the first mobile device 200-1 transfers the keywordand the received additional information to the display device 100. Inoperation S1070, the display device 100 displays the keyword and theadditional information.

With reference to FIGS. 6 to 10, diverse methods for extracting akeyword and searching for additional information have been described.The display device 100 may display the keyword and the additionalinformation using the aforementioned methods. From among theaforementioned methods, one or a combination of two or more methods maybe used. If searching for a keyword and additional information may beperformed by a plurality of devices, it may be possible to designateonly a single device to perform the search according to a priority. Inaddition, it may be possible that a predetermined device or devicessearches for predetermined additional information.

FIG. 11 illustrates display of additional information according to anexemplary embodiment.

With reference to (1) of FIG. 11, the display device 100 is connected tothe mobile device 200. The mobile device 200 receives a call signal fromanother mobile device. The mobile device 200 transfers a callconversation to the display device 100. The display device 100 isproviding a navigation service. The display device 100 may bereproducing content or be providing other operations.

If the display device 100 receives the call signal from the mobiledevice 200, the display device 100 may divide the display unit 130 intotwo portions. An upper portion 21 displays the navigation service, and alower portion 22 displays content related to the received call signal.That is, the lower portion 22 may display notification of reception ofthe call and the caller's name, photograph, and phone number.Information on the caller may have been stored in the display device 100or may be transferred together with the call signal from the mobiledevice 200. The lower portion 22 may further display an “answer” button23, an “ignore” button 24, and a “busy” button 25. If the “ignore”button 24 is selected, the call is ignored. If the “busy” button 25 isselected, a predetermined message is transferred to the caller. If the“answer” button is selected, the call is connected.

With reference to (2) of FIG. 11, if the call is connected, the displaydevice 100 displays keywords extracted from the call conversation, andadditional information related to the extracted keywords. Keywords maybe extracted in real time during the call. As described above, keywordsmay be extracted by at least one of the display device 100, the mobiledevice 200, and the server 400. If a person's name, EEE, is extractedfrom the call conversation, additional information 31 of EEE includingEEE's photograph and phone number may be displayed. If B building isextracted from the call conversation, additional information 33 of Bbuilding including an address of B building may be displayed. Theadditional information may be displayed in real time during the call, orall the additional information may be displayed at the same time afterthe call is finished.

The display device 100 may display the keyword and the additionalinformation in a figure of a predetermined form (e.g. a triangle,quadrangle, pentagon, hexagon, circle, etc.). For example, if a keywordis a person's name, the person's name and phone number may be displayedin a quadrangle. In addition, the person's photograph may be furtherdisplayed. If a keyword is a place name, an icon indicating a place nameand the place name may be displayed in a quadrangle. In addition, theplace's address or phone number may be further displayed. As shown in(2) of FIG. 11, the display device 100 displays additional informationonly when the keyword is a person's name or a place name. In addition,additional information, such as advertisement information and multimediacontent, as well as additional information related to the person's nameand the place name may be further displayed. Furthermore, types ofadditional information to display may be set by the user. The order ofarranging additional information in the display device 100 may be theorder of searching for the additional information or the alphabeticalorder of the keywords, or may be arranged according to the type of thekeyword.

If the displayed additional information is selected, the display device100 performs a corresponding service.

FIG. 12 illustrates a service of changing a destination according to anexemplary embodiment.

With reference to (1) of FIG. 12, the display device 100 displaysadditional information after the call is finished. As described withreference to FIG. 11, the display device 100 displays additionalinformation related to keywords extracted from a call conversation. Ifthe user selects a “close” button 26, the display device 100 closes anadditional information display window and returns to a previous servicescreen. The user selects an additional information menu 33 of Bbuilding.

With reference to (2) of FIG. 12, the display device 100 displaysdetailed information of B building. The detailed information of Bbuilding may include an address and a phone number and further include adestination setting button, a call button, a button for showing reviewsof B building, and a share button. The user selects the destinationsetting button 27.

With reference to (3) of FIG. 12, the display device 100 displays adestination changed by the user selecting the destination setting button27. That is, the display device 100 provides the navigation service ofwhich destination has changed to B building. In this manner, thedestination can easily change so that it may be possible to change thedestination fast and safely while driving.

FIG. 13 illustrates a service of making a call to a third partyaccording to an exemplary embodiment.

With reference to (1) of FIG. 13, the display device 100 displaysadditional information after the call is finished. As described withreference to FIG. 11, the display device 100 displays additionalinformation related to keywords extracted from a call conversation. Ifthe user selects a “close” button 26, the display device 100 closes anadditional information display window and returns to a previous servicescreen. The user selects an additional information menu 31 of personEEE.

With reference to (2) of FIG. 13, the display device 100 makes a call toa phone number of EEE in response to the user's selection. That is, ifthe display device 100 requests the connected mobile device 200 to makea call to EEE, the mobile device 200 tries to make a call to EEE. Atthis time, the display device 100 may divide the display unit 130 intotwo portions. An upper portion 21 may display the navigation service,and a lower portion 22 may display information on the recipient EEE.

FIGS. 12 and 13 illustrate the exemplary embodiments of when additionalinformation of a person's name and a place name are selected. However,additional information may be advertisement information. In this case,the display device 100 may display advertisement additional informationas a menu, and if the user selects the advertisement additionalinformation menu, the display device 100 may display the advertisementinformation.

The display device 100 performs call connection through the mobiledevice 200. However, the display device 100 may perform call connectionwithout the mobile device 200 by including a cellular communicationmodule.

FIG. 14 is a block diagram of a configuration of a display deviceaccording to another exemplary embodiment.

With reference to FIG. 14, the display device 100A may include a storageunit 110, a detection unit 120, a display unit 130, a control unit 140,a communication unit 150, a multimedia unit 160, a photographing unit170, a sensor unit 180, and an input and output unit 190.

The storage unit 110 stores diverse types of multimedia data processedby the control unit 140, content data, and data received from anexternal source.

The storage unit 110 also stores control programs to control the displaydevice 100A or the control unit 140, and applications. Hereinafter, theterm “storage unit” may include a read-only memory (ROM), arandom-access memory (RAM), and a memory card (e.g. a secure digital(SD) card and a memory stick) which is attachable to or detachable fromthe display device 100A. In addition, the storage unit may include anon-volatile memory, a volatile memory, a hard disk drive (HDD), and asolid state drive (SSD).

The storage unit 110 stores a plurality of templates which are setdifferently according to the type of message. In addition, if a callconnection is performed in the display device 100A, the storage unit 110may store a call conversation to transmit to the server 400.

The detection unit 120 detects a plurality of different pieces of stateinformation. The detection unit 120 may receive diverse information froma global positioning system (GPS) module 155, the ECU 300, or the server400, and detect state information.

The display unit 130 displays multimedia content, images, video, text,etc according to control of the control unit 140. The display unit 130may be implemented in a general display panel which does not have atouch input function, or a touch display panel which recognizes theuser's manipulation using a proximity sensor or a touch sensor. If thedisplay unit 130 is a touch display panel, the display unit 130 mayreceive at least one touch gesture through the user's body (e.g. fingersincluding a thumb) or a detectable input means (e.g. a stylus pen).

Such a user interface may include a predetermined touch area, a softkey, and a soft menu. The display unit 130 may transfer an electronicsignal corresponding to at least one touch gesture input through theuser interface to the display unit 130 through a liquid crystal display(LCD) controller (not shown). In addition, the display unit 130 maydetect continuous movement of a touch, and transfer an electronic signalcorresponding to continuous or discontinuous movement of the touch tothe LCD controller.

The display unit 130 may be implemented in a resistive way, capacitiveway, infrared way, or acoustic wave way.

The display unit 130 converts a detection signal regarding the user'sgesture detected by the touch sensor into a digital signal (e.g. X and Ycoordinates), and transfers the digital signal to the control unit 140.The control unit 140 performs a control operation corresponding to theuser's gesture input through the display unit 130 using the receiveddigital signal. For example, the control unit 140 may select a soft keydisplayed on the display unit 130 in response to the user's gesture orexecute an application corresponding to the soft key.

The user's gesture is not limited to direct contact between the displayunit 130 and the user's body or the touchable input means, but includesmethods by non-contact. Sensitivity of the user's gesture which can bedetected by the display unit 130 may vary according to performance orstructure of the display device 100A.

The control unit 140 includes a central processing unit (CPU), a ROMwhich stores a control program to control the display device 100A, andRAM which remembers a signal or data input from outside of the displaydevice 100A and which is used as a memory area for jobs performed by thedisplay device 100A. The CPU may include at least one of a single coreprocessor, a dual core processor, a triple core processor, and a quadcore processor. The CPU, the ROM, and the RAM are connected to oneanother through a local bus.

The control unit 140 controls the storage unit 110, the detection unit120, the display unit 130, the communication unit 150, the multimediaunit 160, the photographing unit 170, and the sensor unit 180.

The communication unit 150 may include a cellular communication module151, a wireless LAN module 152, a local communication module 153, aconnector 154, a global positioning system (GPS) module 155, and abroadcast communication module 156.

The cellular communication module 151 connects the display device 100Ato an external device (in particular, a base station of a cellularsystem) through one or more antenna (not shown) using wireless accesstechnology according to a cellular communication protocol in accordancewith control of the control unit 140.

In addition, the cellular communication module 151 transmits or receivesa wireless signal containing voice calls, video calls, short messagingservice (SMS) messages, or multimedia messaging service (MMS) messagesto or from a communicable device, such as a mobile phone, a smart phone,a tablet PC or other devices, which has a phone number to be input tothe display device 100A.

The wireless LAN module 152 may access the internet at a place in whicha wireless access point (AP, not shown) is installed, according tocontrol of the control unit 140. The wireless LAN module 152 supportswireless LAN standards (IEEE802.11x) of the Institute of Electrical andElectronics Engineers (IEEE).

The local communication module 153 performs wireless localcommunications between the display device 100A and an external deviceaccording to control of the control unit 140. The local communicationmethods may include Bluetooth, infrared data association (IrDA)communication, NFC, etc.

The connector 154 provides an interface, such as USB 2.0, USB 3.0, HDMI,IEEE 1394, etc, between the display device 100A and diverse devices. Theconnector 154 may be used as an interface which links the display device100A with an external device or a power source. According to control ofthe control unit 140, the connector 154 may transmit data stored in thestorage unit 110 to an external device or receive data from an externaldevice through a cable which is connected to the connector 154. Using acable, the connector 154 may receive power from a power source or chargeits battery (not shown).

The GPS module 155 receives a radio wave from a plurality of earthorbiting GPS satellites (not shown), and measures location of thedisplay device 100A using time of arrival from the GPS satellites to thedisplay device 100A and GPS parameters.

The broadcast communication module 156 receives a broadcast signal (e.g.a television (TV) broadcast signal, a radio broadcast signal, or a databroadcast signal) and additional broadcast information (e.g. anelectronic program guide (EPG) or an electronic service guide (ESG))from a broadcast station through a broadcast communication antenna (notshown) according to control of the control unit 140.

The multimedia unit 160 may include an audio reproduction module 161 anda video reproduction module 162. The audio reproduction module 161reproduces stored or received digital audio files (e.g. files havingfile extensions such as “mp3”, “wma”, “ogg”, and “way”) according tocontrol of the control unit 140. The video reproduction module 162supports diverse forms of codec so as to reproduce digital video files.That is, the video reproduction module 162 reproduces a video file usinga pre-stored codec which is suitable for a codec format of the videofile to reproduce. The audio reproduction module 161 and the videoreproduction module 162 of the multimedia unit 160 may be included inthe control unit 140.

The photographing unit 170 photographs a still image or a moving imageaccording to control of the control unit 140. The photographing unit 170may include a plurality of cameras. The photographing unit 170 mayinclude a supplementary light source (e.g. a flash (not shown)).

The photographing unit 170 transfers a photographed image to the controlunit 140. The control unit 140 analyzes an image, detects the user'smovement or shape, and performs a control operation corresponding to thedetected movement or shape. For example, the user's movement indicatesthe movement of the user's hand which is detected through thephotographing unit 170. The user's shape indicates the user's facialshape which is detected through the photographing unit 170.

In another exemplary embodiment, the display device 100A may detect theuser's movement using a device such as an infrared detector, and executeor control an application in response to the user's movement.

Furthermore, the photographing unit 170 may be provided separately fromthe display device 100A. For example, the display device 100A may beprovided inside a vehicle, and the photographing unit 170 may beprovided outside the vehicle (e.g. a front side or back side of thevehicle). The display device 100A may be connected to the photographingunit 170 through a cable or wirelessly so that the display device 100Acan display an image of the front side or back side of the vehiclephotographed by the photographing unit 170.

The sensor unit 180 may include at least one of a touch sensor 181, ageomagnetic sensor 182, an acceleration sensor 183, and a proximitysensor 184.

The touch sensor 181 senses the user's touch on the display unit 130.Methods of sensing the user's touch using the touch sensor 181 include acapacitive method and a piezoelectric method. The touch sensor 181according to an exemplary embodiment of the present invention may beimplemented in the two methods. The touch sensor 181 may constitute thedisplay unit 130 together with a display panel.

The touch sensor 181 is a sensor capable of inputting an indication onthe display screen by pressing the touch screen using a body such as afinger or a detectable input means. The touch sensor 181 usescapacitance change, resistance change, or light change.

The geomagnetic sensor 182 senses azimuth by detecting terrestrialmagnetism so that direction of the display device 100A can berecognized. The acceleration sensor 183 processes an output signal andmeasures dynamic force, such as acceleration, vibration, and impact ofan object, thereby sensing change in moving speed of the display device100A or strength of force. The proximity sensor 184 senses whether ornot the display device 100A approaches an object.

Although not shown in FIG. 14, the sensor unit 180 may further includeat least one of a gravity sensor for sensing in which direction gravityacts, a gyro sensor for recognizing a total of 6 axes by rotating anexisting acceleration sensor, an orientation sensor for automaticallysensing horizontal and vertical frames of content such as an image andautomatically rotating and arranging the content, an illumination sensorfor sensing intensity of illumination around the display device 100A, analtitude measuring sensor for measuring atmospheric pressure, an RGBsensor for sensing color of an object, a distance measuring sensor formeasuring a distance using ultrasonic waves or infrared light, and ahall sensor for sensing change in the voltage according to strength ofmagnetic field.

Each sensor of the sensor unit 180 detects its state, generates a signalcorresponding to the detected state, and transfer the signal to thecontrol unit 140. Each sensor of the sensor unit 180 may be added ordeleted according to the performance of the display device 100A.

The input and output unit 190 may include a button unit 191, amicrophone 192, a speaker 193, and a vibration motor 194.

At least one button unit 191 may be provided on a front, side, or backof the body of the display device 100A in a push type or a touch type,and may include at least one of a power/lock button, a volume controlbutton, a menu button, a home button, a back button, and a searchbutton.

The microphone 192 receives voice or sound and generates an electricalsignal according to control of the control unit 140.

The speaker 193 may output sounds corresponding to diverse signals (e.g.wireless signals, broadcast signals, digital audio files, digital videofiles, or photographing) of the cellular communication module 151, thewireless LAN module 152, the local communication module 153, themultimedia unit 154, or the photographing unit 170 to the outside of thedisplay device 100A according to control of the control unit 140.

The speaker 193 may output sounds (e.g. button manipulation sounds orring back tone corresponding to calling) corresponding to functions ofthe display device 100A. One or more speakers 193 may be provided onappropriate locations of the body of the display device 100A. Forexample, the speaker 193 may include an internal speaker module which isprovided on a location suitable for approaching the user's ears who ison the phone, and an external speaker module which has a large outputsuitable for reproducing audio and video files or showing a broadcastand which is provided on an appropriate location of the body of thedisplay device 100A.

The vibration motor 194 converts an electrical signal into a mechanicalvibration according to control of the control unit 140. For example, ifthe display device 100A in vibration mode receives a call from anotherdevice (not shown), the vibration motor 194 operates. One or morevibration motors 194 may be provided in the body of the display device100A. The vibration motor 194 may operate in response to the user'stouch gesture or continuous movement of touch which is detected on thedisplay unit 130.

A power unit (not shown) supplies power to the display device 100A. Thepower unit may be implemented in a rechargeable battery and may furtherinclude a voltage converter which converts external power supply andsupplied converted power to the rechargeable battery.

The power unit may supply power to the display device 100A in diversemodes, such as maximum performance mode, general mode, power savingmode, and standby mode, according to power management control of thecontrol unit 140.

The display device 100A may transfer a call conversation and locationinformation of the display device 100A to the server 400 and receivediverse information related to the call conversation and the locationinformation from the server 400. The display device 100A does not alwaysinclude all of the aforementioned components but may include some ofthem according to an exemplary embodiment.

FIG. 15 is a timing chart illustrating a method for providing anadvertisement service according to an exemplary embodiment.

With reference to FIG. 15, the mobile device 200 receives a call signalfrom another mobile device. In operation S1505, the mobile device 200transfers a call conversation to the display device 100. In operationS1510, the mobile device 200 transfers the call conversation andlocation information to the server 400. The mobile device 200 mayreceive the location information through a GPS module or from thedisplay device 100. The call conversation and the location informationmay be encrypted and be transmitted to the server 400.

In operation S1515, the server 400 extracts a call keyword from the callconversation. The call keyword is main terms or repeated terms in thecall conversation. In operation S1520, the server 400 searches foradvertisement information based on the extracted call keyword and thereceived location information. The call keyword may be given a priority.Only call keywords of up to a predetermined priority may be used for asearch.

In operation S1525, the server 400 may transfer the found advertisementinformation to the mobile device 200. In operation S1530, the mobiledevice 200 may display the received advertisement information.Alternatively, in operation S1535, the server 400 may transfer the foundadvertisement information to the mobile device 200 and an externaldisplay device 500 which exists within a predetermined area. Inoperation S1540, the external display device 500 may display thereceived advertisement information. The server 400 may transfer thefound advertisement information to one or both of the mobile device 200and the external display device 500.

In operation S1545, the mobile device 200 may transfer the advertisementinformation to the display device 100. The mobile device 200 and thedisplay device 100 may be connected to each other through a cable orwirelessly (e.g. using Bluetooth or WiFi). In operation S1550, thedisplay device 100 displays the advertisement information.

In FIG. 15, the advertisement information is used as an example ofadditional information. However, advertisement information is merely anexemplary embodiment. Multimedia content, movie information, sportshighlight information, etc may be used as additional information. Inaddition, in FIG. 15, the single server 400 receives the locationinformation and the call conversation, extracts the call keyword, andsearches for the advertisement information. However, it may be possiblethat if the server 400 extracts a call keyword and transfers theextracted call keyword and the location information to another server,another server searches for the advertisement information.

FIG. 16 is a timing chart illustrating a method for providing anadvertisement service according to another exemplary embodiment. In theexemplary embodiment of FIG. 16, the mobile device 200 extracts akeyword.

With reference to FIG. 16, the mobile device 200 receives a call signalfrom another mobile device. In operation S1605, the mobile device 200transfers a call conversation to the display device 100. In operationS1610, the mobile device 200 extracts a keyword from the callconversation. Detailed process is the same as that of FIG. 15. However,the keyword is extracted by the mobile device 200. When the mobiledevice 200 extracts a keyword, the user may set the mobile device 200 toextract specific types of keywords. For example, only keywords relatedto a person's name and place name may be set to be extracted, or onlyadvertisement information may be set to be extracted. Or, all types ofkeywords, not specific types of keywords, may be set to be extracted.

In operation S1615, the mobile device 200 transfers the extractedkeyword and location information to the server 400. The mobile device200 may receive the location information through a GPS module or fromthe display device 100.

In operation S1620, the server 400 searches for advertisementinformation based on the extracted call keyword and the receivedlocation information. At this time, the server 400 may be a searchserver which simply performs search. In operation S1625, the server 400may transfer the found advertisement information to the mobile device200. In operation S1630, the mobile device 200 may display the receivedadvertisement information. Alternatively, in operation S1635, the server400 may transfer the found advertisement information to the mobiledevice 200 and an external display device 500 which exists within apredetermined area. In operation S1640, the external display device 500may display the received advertisement information. The server 400 maytransfer the found advertisement information to one or both of themobile device 200 and the external display device 500.

In operation S1645, the mobile device 200 may transfer the advertisementinformation to the display device 100. The mobile device 200 and thedisplay device 100 may be connected to each other through a cable orwirelessly (e.g. using Bluetooth or WiFi). In operation S1650, thedisplay device 100 displays the advertisement information.

FIG. 17 illustrates an exemplary embodiment in which the mobile deviceand the display device are connected to a vehicle according to anexemplary embodiment.

In FIG. 17, the display device 100 and the mobile device 200 areconnected to each other in the vehicle in a wireless communicationmethod. The display device 100 and the mobile device 200 may also beconnected via a cable. In FIG. 17, the display device 100 is built inthe vehicle. However, it is also possible that the display device 100exists independently and is attachable to or detachable from thevehicle. In addition, although not shown in FIG. 17, the display device100 may be connected to an ECU of the vehicle.

If the display device 100 and the mobile device 200 are connected toeach other as shown in FIG. 17, the mobile device 200 transfers receivedcalls, messages, or data to the display device 100. If the ECU (notshown) is connected to the display device 100, the ECU transfersinformation on the vehicle to the display device 100. The display device100 displays diverse data received from the mobile device 200 or theECU.

The display device 100, the mobile device 200, or the ECU figures out alocation of the vehicle using their GPS chips. That is, locationinformation of the display device 100, location information of themobile device 200, or location information of the ECU may be consideredthe location of the vehicle.

Additional information found by the server 400 may be transferred to thedisplay device 100 through the mobile device 200. The display device 100displays the received additional information. For example, if the server400 searches for advertisement information related to movie QQQ, theadvertisement information of movie QQQ is transferred through the mobiledevice 200 to the display device 100. The display device 100 displaysthe advertisement information of movie QQQ.

In the example of FIG. 17, the single mobile device 200 of the driver isconnected to the display device 100. However, if a plurality ofpassengers in the vehicle have their own mobile devices, the displaydevice 100 may be connected to the plurality of mobile devices in thevehicle using a local wireless communication method. At this time, ifthe display device 100 receives advertisement information, the displaydevice 100 may transfer the advertisement information to the pluralityof mobile devices.

As described above, additional information such as advertisementinformation may be transferred to an external display device 500.

FIG. 18 illustrates a method for providing a service to a plurality ofterminal devices according to an exemplary embodiment.

With reference to (1) of FIG. 18, there are five users around a singleexternal display device 500. Location information of the users may besearched using GPS information. In general, people have their own mobiledevices, so location information of the mobile device 200 can be thesame as that of the users.

With reference to (2) of FIG. 18, if a plurality of users call differentpeople, call conversation and location information of the plurality ofusers are transmitted to the server 400. The server 400 categorizesusers to share the same external display device 500 based on thelocation information. The server 400 extracts a call keyword from callconversations of the categorized users. The server 400 may extract callkeywords with priority according to the users. In this case, differentadvertisement information for each user may be found. Or, the server 400may consider call conversations of the entire users as one and extractcall keywords with priority from the call conversations of the entireusers. In this case, a plurality of pieces of advertisement informationrelated to a call conversation of a single user may be found.

The server 400 may transfer the found advertisement information tomobile devices 200-1, 200-2, 200-3, 200-4, and 200-5 of the users, ortransfer the plurality of pieces of advertisement information to theexternal display device 500 adjacent to the plurality of users.

Advertisement information may be transferred in the order ofadvertisement information having the highest priority and/or in theorder of a terminal device of a user who hangs up the phone the mostbriefly.

Until now, the process of detecting current state information using themobile device 200 and transferring a message conveniently, and theprocess of transferring call conversation and location information tothe server 400 and receiving advertisement information related to a callkeyword and the location information have been described. Meanwhile, themobile device 200 is connected to the display device 100, and thedisplay device 100 may be connected to an ECU (not shown) of a vehicle.The display device 100 may be connected to the ECU using a controllerarea network (CAN).

FIG. 19 illustrates a data frame format of a CAN according to anexemplary embodiment.

The CAN indicates a network system for a vehicle to provide digitalserial communication between diverse measuring control devices of avehicle. Complex electric wiring and relay of electronic components in avehicle are replaced with a serial communication line so that weight andcomplexity can be reduced. In addition, presence or absence ofabnormality caused by electronic interference can be diagnosed.

The CAN is a standard of a multimaster broadcast serial bus to connectthe ECU. Each node may transfer or receive a message, but each node maytransfer or receive a message at the same time. A message includes anidentification (ID) for indicating a priority order of the message of upto 8 bytes. Devices which are connected to the CAN are generallysensors, actuators, and other control devices. Such devices are notdirectly connected to a bus, but are connected through a host processorand a CAN controller.

A CAN protocol includes a physical layer, a transfer layer, an objectlayer, and an application layer, as in other network protocols. The CANmay be set in two different message (or frame) formats. A general framesupports 11 bits of identifier, and an extension frame supports 29 bitsof identifier.

With reference to FIG. 19, a CAN data frame format includes 1 bit ofstart of frame field 1305, 11 bits or 29 bits of identifier field 1310,1 bit of remote transmission request (RTR) field 1315, 6 bits of controlfield 1320, 0 to 8 bytes of data field 1325, 15 bits of cyclicredundancy checking (CRC) field 1330, 1 bit of CRC delimiter field 1335,1 bit of ACK slot 1340, 1 bit of ACK delimiter field 1345, and 7 bits ofend of frame field 1350.

The start of frame field 1305 indicates a start of a transferred frame.The identifier field 1310 is for data representing a message priorityorder. When two nodes transfer a message at the same time, the order isdetermined according to a priority order of the identifier field 1310.When the RTR field 1315 is 0, a data frame is dominant, and when the RTRfield 1315 is 1, a remote frame is recessive. The remote frame is aframe which is output when a receiver requests data from a transmitter.

The control field 1320 includes 1 bit of identifier extension bit (IDE)field, 1 bit of reserved bit field, and 4 bits of data length codefield. The data field 1325 contains data to transfer. The CRC field 1330checks an error by separating a predetermined section of bits. If theACK slot 1340 is 1, the transmitter transmits a recessive state.

The CRC delimiter field 1335, the ACK delimiter field 1345, and the endof frame field 1350 become 1 in the recessive state.

As described above, communications in the ECU is enabled using the CAN,and state information of the vehicle can be transferred to the displaydevice 100, such as the head unit of the vehicle.

Flow charts of a method for providing a service are described.

FIG. 20 is a flow chart illustrating a method for providing a serviceusing a display device according to an exemplary embodiment.

In operation S2010, a display device communicates with a mobile device.The display device receives a call signal from the mobile device, andrequests the mobile device to make a call or transfer a message. Thedisplay device may be connected to the mobile device via a cable orwirelessly.

In operation S2020, the display device acquires a keyword included in acall conversation. The display device may acquire a keyword from anaudio signal including the call conversation. Alternatively, the displaydevice converts the audio signal into text and acquires a keyword fromthe converted text. In some cases, the display device may receive akeyword extracted by the mobile device or a server.

In operation S2030, the display device displays additional informationcorresponding to the keyword. The display device searches at least oneof its storage unit, the mobile device, and the server. The additionalinformation is displayed with the keyword. The keyword may be a person'sname, a place name, a movie, time, advertisement, etc. The additionalinformation may be a phone number, a photograph, an address,advertisement information, multimedia content, etc. If one of thedisplayed additional information is selected, the display deviceprovides a corresponding service.

FIG. 21 is a flow chart illustrating a method for providing a serviceusing a mobile device according to an exemplary embodiment of thepresent invention.

In operation S2110, a mobile device communicates with a display device.In operation S2120, the mobile device makes a call to anothercommunication device. The mobile device receives a call signal from thecommunication device and transfers the call signal to the displaydevice. If call connection is selected on the display device, the mobiledevice transfers a call conversation to the display device.

In operation S2130, the mobile device transfers the call conversation toa server, receives advertisement information corresponding to a keywordincluded in the call conversation, and transfers the advertisementinformation to the display device. If the mobile device transfers thecall conversation to the server, the server may store the callconversation in a corresponding personal profile and extract a keywordfrom the call conversation. The server searches for additionalinformation related to the keyword and transfers the found additionalinformation to the mobile device. The mobile device receives theadvertisement information and transfers the advertisement information tothe display device.

The method for providing a service using the display device according tothe diverse exemplary embodiments may be implemented in a program and beprovided to a terminal device.

For example, a program capable of communicating with a mobile device,acquiring a keyword from a call conversation if the mobile device makesa call, and displaying additional information corresponding to thekeyword may be stored in a non-transitory computer readable medium.

A non-transitory computer readable medium is a medium which does notstore data temporarily such as a register, cash, and memory but storesdata semi-permanently and is readable by devices. More specifically, theaforementioned diverse applications or programs may be stored andprovided in a non-transitory computer readable medium such as a compactdisk (CD), digital video disk (DVD), hard disk, Blu-ray disk, universalserial bus (USB), memory card, and read-only memory (ROM).

The foregoing exemplary embodiments and advantages are merely exemplaryand are not to be construed as limiting the present invention. Thepresent teaching can be readily applied to other types of apparatuses.Also, the description of the exemplary embodiments is intended to beillustrative, and not to limit the scope of the claims, and manyalternatives, modifications, and variations will be apparent to thoseskilled in the art.

What is claimed is:
 1. A display device which is provided at a vehicle,the display device comprising: a communicator configured to communicatewith a mobile device; a controller configured to acquire at least onekeyword in a call conversation if the mobile device makes a call; and adisplay configured to display additional information corresponding tothe at least one keyword.
 2. The display device as claimed in claim 1,wherein the additional information comprises advertisement informationcorresponding to the at least one keyword, if a server configured tostore an advertisement database transfers the advertisement informationcorresponding to the at least one keyword, the communicator receives thetransferred advertisement information through the mobile device, and thecontroller displays the received advertisement information using thedisplay.
 3. The display device as claimed in claim 1, wherein if thedisplayed additional information is selected, the controller provides aservice corresponding to the selected additional information.
 4. Thedisplay device as claimed in claim 3, wherein the additional informationcomprises at least one from among location information, contactinformation, multimedia content, and advertisement information, and ifthe location information is selected, the controller provides anavigation service for guiding a route to a destination corresponding tothe location information, if the contact information is selected, thecontroller provides a call service for making a call related to thecontact information, if the multimedia content is selected, thecontroller provides a service for reproducing the multimedia content,and if the advertisement information is selected, the controllerprovides an advertisement service for displaying a screen including theadvertisement information.
 5. The display device as claimed in claim 1,further comprising: a storage, wherein the controller searches for theadditional information corresponding to the at least one keyword fromamong information which is stored in at least one from among a server,the mobile device, another mobile device which is connected to themobile device, and the storage.
 6. The display device as claimed inclaim 1, wherein if the call conversation of the mobile device isreceived through the communicator, the controller extracts and acquiresthe at least one keyword from the call conversation and searches for theadditional information based on the at least one keyword.
 7. A mobiledevice comprising: a communicator configured to communicate with adisplay device provided at a vehicle; a call connector configured tomake a call to another mobile device; and a controller configured totransfer a call conversation to a server, receive advertisementinformation corresponding to at least one keyword in the callconversation, and transfer the advertisement information to the displaydevice.
 8. A service providing system comprising: a mobile deviceconfigured to make a call to another mobile device; and a display deviceconfigured to communicate with the mobile device and acquire at leastone keyword in a call conversation if the mobile device makes the callto the another mobile device, wherein the display device displaysadditional information corresponding to the at least one keyword.
 9. Amethod for providing a service using a display device, the methodcomprising: communicating with a mobile device; acquiring at least onekeyword in a call conversation if the mobile device makes a call; anddisplaying additional information corresponding to the at least onekeyword.
 10. The method as claimed in claim 9, wherein the additionalinformation comprises advertisement information corresponding to the atleast one keyword, if a server which stores an advertisement databasetransfers the advertisement information corresponding to the at leastone keyword, receiving the transferred advertisement information throughthe mobile device, and displaying the received advertisementinformation.
 11. The method as claimed in claim 9, further comprising:if the displayed additional information is selected, providing a servicecorresponding to the selected additional information.
 12. The method asclaimed in claim 11, wherein the additional information comprises atleast one from among location information, contact information,multimedia content, and advertisement information, and in the providingof the service, if the location information is selected, a navigationservice for guiding a route to a destination corresponding to thelocation information is provided, if the contact information isselected, a call service for making a call related to the contactinformation is provided, if the multimedia content is selected, aservice for reproducing the multimedia content is provided, and if theadvertisement information is selected, an advertisement service fordisplaying a screen including the advertisement information is provided.13. The method as claimed in claim 9, further comprising: searching forthe additional information corresponding to the at least one keywordfrom among information which is stored in at least one of a server, themobile device, another mobile device which is connected to the mobiledevice, and a storage.
 14. The method as claimed in claim 9, furthercomprising: if the call conversation of the mobile device is received,extracting and acquiring the at least one keyword from the callconversation and searching for the additional information based on theat least one keyword.
 15. A method for providing a service using amobile device, the method comprising: communicating with a displaydevice provided at a vehicle; making a call to another mobile device;and transferring a call conversation to a server, receivingadvertisement information corresponding to at least one keyword in thecall conversation, and transferring the advertisement information to thedisplay device.
 16. The display device as claimed in claim 2, whereinthe received advertisement information is displayed after an end of thecall conversation.
 17. The method as claimed in claim 10, wherein thereceived advertisement information is displayed after an end of the callconversation.
 18. The method as claimed in claim 15, wherein thereceived advertisement information is transferred to the display deviceafter an end of the call conversation.